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Living systems need to be highly responsive, and also to keep fluctuations low. These goals are 
incompatible in equilibrium systems due to the Fluctuation Dissipation Theorem (FDT). Here, we 
show that biological sensory systems, driven far from equilibrium by free energy consumption, can 
reduce their intrinsic fluctuations while maintaining high responsiveness. By developing a continuum 
theory of the E. coli chemotaxis pathway, we demonstrate that adaptation can be understood as a 
non-equilibrium phase transition controlled by free energy dissipation, and it is characterized by a 
breaking of the FDT. We show that the maximum response at short time is enhanced by free energy 
dissipation. At the same time, the low frequency fluctuations and the adaptation error decrease 
with the free energy dissipation algebraically and exponentially, respectively. 
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Living organisms need to respond to external signals 
with high sensitivity, and at the same time, they also 
need to control their internal fluctuations in the absence 
of signal. In equilibrium systems, the fluctuation dissi¬ 
pation theorem (FDT) dictates that these two desirable 
properties, high sensitivity and low fluctuation, can not 
be satisfied simultaneously. Most sensory and regula¬ 
tory functions in biology are carried out by biochemical 
networks that operate out of equilibrium - metabolic en¬ 
ergy is spent to drive the dynamics of the network [1-4]. 
Thus, in principle they are not constrained by the FDT 
[5]. However, how fluctuations, energy dissipation, and 
sensitivity are related for such systems remains not well 
understood. Here, we address this question by studying 
a negative feedback network responsible for adaptation 
in the bacterial chemosensory system [6-9]. 

A typical adaptive behavior in a small system such as 
a single cell is shown in Fig. lA [10]. In response to a 
change of the signal S, the output y of the sensory system 
first changes quickly with a fast time scale Ty. After the 
fast response, the output slowly adapts back towards its 
pre-stimulus level Oad with an adaptation time Tad S> Ty. 
The new steady state (adapted) output may differ from 
the pre-stimulus value, and the difference is quantified 
by the adaptation error e. In our previous work [11], we 
showed that the negative feedback network responsible 
for adaptation operates out of equilibrium with a finite 
free energy dissipation rate W. The average adaptation 
error (e) was found to decrease exponentially with VFrad. 
However, how the variance cr^ of the error behaves in an 
adaptive system still remains unknown. This is an im¬ 
portant question as adaptive feedback systems are intrin¬ 
sically noisy due to the slow adaptation dynamics [12]. 

In the linear response regime, the output response of 
a system to an input signal S{t) is given by R{t) = 
R{0) + /p x{t — t')S{t')dt', where y is the response func¬ 
tion. For equilibrium systems, under the general assump¬ 
tion that response and signal are conjugate variables, 



FIG. 1: Noisy response of feedback adaptation. A) 

Adaptive output response to a step input signal increase at 
time 0. After a sharp response in a time Ty, the output y 
recovers back in a time Tad to its adapted value Uad. The 
adaptation error is characterized by its average (e), as well 
as its variance Uj. B) Schematic of the feedback adaptation 
model. Transitions between the active and inactive memory 
energy landscapes, fi and /o, are mediated via equilibrium 
activity transitions with rates, wo and cui. An external energy 
input p is used to drive the memory variable uphill in both 
the active and inactive states. The result is a dissipative loop 
of probability flow around the adapted memory state mad, 
which ensures the output to be near Oad. 


the FDT establishes that x(t) = —/?9tC'fl(t)0(t), where 
C'fl(t) = {R{t)R{0)) — (i?)^ is the auto-correlation func¬ 
tion, Q{t) is the Heaviside function, and /3 = {kBT)~^ 
is the inverse thermal energy set to unity hereafter. 
For a small step stimulus S{t) = So<d{t), integration 
of the FDT leads to a relation between the response 
and its correlation: R{t) = R{0) — S'o(C'_r(<) — C'i^(O)). 
Since for equilibrium systems Cii{t) is a monotonically 
decreasing function of time [13], the response R{t) is 
also monotonic in time, and thus no adaptation dynam¬ 
ics is possible. Furthermore, the long time response 
AR = R{t = oo) — R(0) is linearly proportional to the 
variance cr^ = Cji(O), i.e., AR = Sou^. 

In this paper, we show that in a non-equilibrium adap¬ 
tive system both the average adaptation error (e) (anal¬ 
ogous to AR) and its variance (analogous to (j\) are 
suppressed by the free energy dissipation of the system 
but in different ways, which results to a nonlinear (log- 
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arithmic) relationship between them. More importantly, 
violation of the FDT allows suppression of noise without 
compromising the strength of the fast response. 

The continuous model of feed-back adaptation. We 
start by introducing a discrete adaptation model moti¬ 
vated by the E. coli chemotaxis pathway. The system is 
characterized by its binary receptor activity A = 0,1, 
which determines the output y, and an internal con¬ 
trol variable M = 0,1,...,fV, that corresponds to the 
chemoreceptor’s methylation level in E. coli chemotaxis 
[9]. For a given external input signal S, the free energy 
of the system can be written as: 

Fa{M, S) = -(A - 1/2)[(M - M,)E -{S- ^r)], (1) 

where S'r is a reference signal at a methylation level 
and E sets the methylation energy scale. For E. coli 
chemotaxis, the signal S depends on the ligand attractant 
concentration logarithmically [14]. 

The dynamics of the system is characterized by the 
transitions between the 2 x {N 1) states in the Ax M 
phase space. The receptor activity switches at a time 
scale To, which is much shorter than the adaptation 
time scale Tad at which the internal variable M is con¬ 
trolled. The receptor activity A determines the out¬ 
put y of the signaling pathway. In the case of E. coli 
chemotaxis, this is carried out by the phosphorylation 
and dephosphorylation reactions of the response regu¬ 
lator CheY with an intermediate time scale t^: Tad ^ 
Ty Ta- To account for this, we relate A and y by 
y{t) = Ty^ A{t')dt', which averages the fast 

binary activity over the time scale Ty. 

According to Eq. (1), a larger signal S favors the inac¬ 
tive state A = 0. Thus, an increase in S quickly reduces 
the system’s average activity, at time scale ~ Ta, and 
output, at time scale ~ t^, as represented in Fig. lA. Af¬ 
ter this sudden initial response, the system slowly adapts 
by adjusting its internal variable M to balance the effect 
of the increased signal. Due to its slow time scale, M 
effectively serves as a memory of the system. This adap¬ 
tation process restores activity and output to a level near 
its pre-stimulus value (A) = (y) « Uad- Although highly 
precise, this adaptation process is imperfect, and its in¬ 
accuracies are quantified by the adaptation error e, which 
we define as 


For E. coli chemotaxis, the adaptive machinery consists 
of chemical reactions that increase M in the inactive state 
and decrease it in the active state. Note from Eq. (1) that 
such regulatory reactions are energetically unfavorable, 
and thus require a chemical driving force /i, see Eig. IB. 

To gain analytical insights about dynamics and ener¬ 
getics of adaptation, we consider the limit where N ^ oo 
and TO = M/N G [0,1] becomes a continuous variable 


[15]. Note that free energy and bare rates need to be 
rescaled for the continuum limit to converge (see Supple¬ 
mentary Information, SI, for details). Proceeding in this 
way we obtain two coupled Fokker-Planck equations that 
describe the chemotaxis pathway dynamics: 

dtPi = Po^o - Pi^i - dmJi 

dtPo = Piwi - poioo - dm Jo, (3) 

where pi{rn, t) and po{m, t) are the joint probabilities for 
the active and inactive states with a given to respectively. 
The probability currents are given by 

Ja = Da ((-dmfA - p)pA - dmPA) , A = 0,1, (4) 

where /a(w) = —(A — 1/2)[(to — mr)e — {S — S'r)] is the 
continuum limit of Eq. (1) characterized by the rescaled 
energy parameter e = NE. The fast transition rates 
between the active and inactive states, wq and wi, satisfy 
detailed balance loq/uji = exp(/o —/i). The diffusion-like 
constants Di and Dq set the time-scale of to changes for 
active and inactive states, and thus the adaptation time 
goes as Tad ~ see SI for details. Our model is 

analogous to that of an isothermal ratchet [16], where 
a chemical driving fuels directed motion. Whereas in 
ratchets y, drives directed motion, here it fuels currents 
up the energy landscapes /o and fi to achieve adaptation. 

In the absence of external driving, i.e. y = 0, the 
system relaxes to a state of thermal equilibrium with no 
phase-space fluxes Jq = Ji = 0. In this regime adapta¬ 
tion is impossible. The chemical driving y > 0 breaks 
detailed balance and creates currents that increase to in 
the active state and decrease it in the inactive state. For 
large enough y, the memory variable to can be stabilized 
(trapped) in a cycle around its adapted state TOad, which 
ensures (y) « Oad as illustrated in Fig. IB. The free en¬ 
ergy dissipation rate W can be computed W « C\y\/Ts,d 
with C a system specific constant set to unity by our pa¬ 
rameter choice, see SI. In the following, we will use the 
chemical driving y « Tad IF to characterize the system’s 
energy dissipation. 

The dynamics of A, y, and to are illustrated in Fig. 
2A. In the power spectra of Fig. 2B, the high fre¬ 
quency fluctuation of y is suppressed from that of A by 
time-averaging. However, the low frequency fluctuations, 
which are caused by the slow fluctuations of to, are not 
affected. These low frequency noise can be suppressed by 
free energy dissipation, as we show later in this paper. 

Adaptation as a non-equilibrium phase transition. 
Given the separation of time scales Ta <C Tad, we can solve 
Eqs. (3) by using the adiabatic approximation [13, 17]: 
Pi (to) = a(m)p{m), and po(m) = (I — a{m))p(m), with 
a{m) = (I -I- eA(™)“A(m))-i average equilibrated ac¬ 
tivity for a fixed value of to. The distribution of to can 
be written as p{m) = fz with h the effective 

potential and Z a normalization constant. We have de¬ 
termined the effective potential h analytically (see SI for 
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FIG. 2: Adaptation as a non-equilibrium transition A) 

Schematic time traces of the binary activity A (blue), the out¬ 
put y (black), and the memory M (red) in steady state. The 
slow M variations induce large fluctuations in the output y, 
while the fast A switching for a fixed M only produces small 
fluctuations in y. B) Power spectra of the activity Sa and 
output Sy. The output noise is filtered (reduced) in the high 
frequency range < uj < but it remains unfiltered 
in the range < oj < . C) Effective memory poten¬ 

tial in Eq. 5 for three values of the chemical driving y, (due 
to the choice Di — Do taken here, mad = m*). At equi¬ 
librium, ^ = 0, the adapted memory state mad is unstable. 
At the value y — yc the system becomes critical. In the re¬ 
gion y > yc the adapted state mad is stable. Inset: Activity 
response to step signal increase for corresponding values of 
y. D) Effective temperature Teff for three different values of 
the chemical driving y. After the onset of adaptation a re¬ 
gion with “negative friction” develops, at the end of which 
the effective temperature diverges. Values of y from lighter 
to darker blue are y = 0, y — 0.65/rc, and y = 20/ic (the same 
as in panel C). The other parameters are from [17], see SI. 

detailed derivation): 

h{m, S) = ^ 

I^C 

^ ( 5 ) 

where we have defined the critical chemical driving as 
/ic = e/2, and to* = m,- + {S — S^)/e. 

The analytical form of the effective potential is one 
of the main results of this paper. The effect of energy 
dissipation and the onset of adaptation can be under¬ 
stood intuitively with /i(to, S'), which contains two terms 
with similar shapes, see Fig. 2C. The first term (propor¬ 
tional to y/yc) in the right hand side of Eq. (5) comes 
from chemical driving (non-equilibrium effect) and has 
a stable free energy minimum. The second term is the 
equilibrium potential in the absence of driving, and has 
a maximum at to* . At equilibrium the only critical point 
TO* is unstable, so the system tends to go to the bound¬ 
aries without adapting. As y increases the first part of 
the potential starts to dominate. For y > y^ the sys¬ 


tem develops a stable fixed point at TOad away from the 
boundaries, indicating the onset of adaptive behaviors 
[18]. As y increases this fixed point becomes increasingly 
stable, and adaptation accuracy increases. The transition 
of a feedback system to adaptation can thus be loosely 
understood as a continuous phase transition (see SI for 
details). Since the control parameter is the free energy 
dissipation, the transition to adaptation occurs far from 
equilibrium and a breaking of FDT is to be expected. 

Breakdown of Fluctuation Dissipation Theorem. In our 
feedback model, the observable conjugate to the signal is 
eA = —OsJa, but see [19-21] for cases where this is not 
true. The FDT would lead to x(t) = edtCA{t), where y 
is the activity response function and Ca is the monotonic 
correlation function. In an adaptive system the integral 
of X) which is just the response to a step stimulus, is 
non-monotonic, therefore FDT is broken. 

To quantify the departure from equilibrium, we define 
an effective temperature Teff using the formulation of the 
FDT in frequency space [5, 22], see inset in Fig. 2D. 
The frequency-dependence of Teff for p, > 0 implies a 
breakdown of FDT. As shown in Fig. 2D, while for any 
value y 0 we have Teff 7 ^ 1 , after the transition to the 
adaptive regime y > yc b. divergence occurs. This cor¬ 
responds to the appearance of a frequency region where 
Im[x(w)] < 0. A negative effective viscosity indicates the 
dominance of the active effects that drive a net current 
to flow against the gradients of the equilibrium energy 
landscape Ja, something also observed in other biologi¬ 
cal systems such as collections of motors [23] or the inner 
ear hair bundle [5]. The breakdown of FDT means that 
there is no a priori connection among fluctuations cr/, 
chemical driving y, and long-time response (e). In the 
following we derive relations linking these three quanti¬ 
ties in the adaptive feedback system studied here. 

The free energy cost of suppressing fluctuations. As 
evident from the effective potential, increasing the chem¬ 
ical driving y stabilizes the adapted state. In the limit 
y ^ 00 , the system thus goes to its perfectly adapted 
state with average output a^d = Do/{Do + Di). For 
finite y, the output differs from Oad, which can be char¬ 
acterized by the average error (e) and its variance cr/. 

The average adaptation error is (e) = {{y) — aad)/aad- 
Summing and integrating Eqs. (3), we have 

_ Dipi{l) + T)oPo(l) Dipi{0) + DoPoiO) 
Doie/2-y) Doiel2 - y) 

Thus to obtain the adaptation error we only need to eval¬ 
uate the probability at the boundaries. In the limit of 
M Mc! we have: 

(e) « , (7) 

where k and Cc are constants with only weak dependence 
on y (see SI for derivation). This shows explicitly that the 
adaptation error goes down exponentially with energy 
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dissipation, as found numerically in our previous work for 
the discrete model [11]. Here, we show this relationship 
analytically in the continuum limit. Fig. 3A shows results 
from both the continuum and discrete model. 




FIG. 3: Free energy cost of reducing error and noise. 

A). Dependence of average error with chemical driving for 
several system sizes. The decay is exponential, in agreement 
with the infinite size limit (dashed red). Saturation of the 
decay for finite N is due to finite size effects. B) Adaptation 
noise as a function of chemical driving for several system sizes, 
together with the analytical estimate in dashed red. At very 
large driving the noise saturates to its minimum aym dictated 
by the intrinsic activity fluctuations. Note that at the critical 
driving the analytical estimate diverges. This divergence 
is smoothed for finite N. 


Besides stabilizing the adapted state, Eq. (5) shows 
that increasing /j, also reduces the m—fluctuations by 
making the effective potential sharper. The reduction 
in these fluctuations implies a decrease in the variance 
of the error cr^. Taking into account the separation of 
time scales Tq <C Ty <C Tad, the variance of the output 
y can be approximated as the sum of two variances 
and CTa- They respectively correspond to variation of y 
at time scale ~ Ty around its average a(m) for a fixed m, 
and the variation of a(m) due to variation of m at the 
adaptation time ^ Tad. We thus have 

/O-ld ■ ( 8 ) 

The variance ay^ of y is caused by the fast fluctuations 
of the binary variable A at timescale ^ Tq averaged over 
the output timescale Ty ^ t^ (see SI for derivation): 

^ym ~ (®ad ~ ®ad)Ti/ (Tj, + Tq) , 

which clearly shows that ffy^ ex Tq/t^ is reduced by time¬ 
averaging. 

The variance = (a)^ — (a^), where (a") = 

/p a'^ (m)p{m)dm for n = 1,2, is caused by the slow vari¬ 
ation of m. To obtain an analytical expression for 
we approximate p{m) by a Gaussian, valid for /j, 3> /ic. 
This results in « ('9m«ad)^cr^/aad- The variance 
cr^ = (m)^ — (m^) within the same Gaussian approxi¬ 
mation of p{m) is given by « {yp,c)~^■ Defining now 
a characteristic variance as = 4(1—aad)^a^j, we finally 
have: 


a 


2 

a 




(9) 


which vanishes when ^ oo. This is a main result of 
the paper, which shows that energy dissipation is used 
to reduce error noise by suppressing slow activity fluc¬ 
tuations. Figure 3B compares this expression to several 
discrete models with increasing N. 



FIG. 4: Response and correlations in systems out of 

equilibrium. A) (top panel) Average output response to a 
signal decrease for several values of the chemical driving be¬ 
yond Pc see the color-code for y, in panel B. As the chemical 
driving y increases, the maximal transient response (i/)max in¬ 
creases, but the long time response A{y) = aad(e) decreases, 
(bottom panel) The correlation function also decreases as the 
system is driven further away from equilibrium. B) The de¬ 
pendence of (i/)max, A{y), and (j/)max on the chemical driving 
y. The long-time response (adaptation error) A{y) decreases 
quickly with y. The decrease of the output fluctuation (noise) 
Gy with y is more gradual, and controls the increase in the 
maximal response (i/)max for large y. In this figure N = 15, 
and S = Sr- 


Discussion. Biochemical networks are non-equilibrium 
systems fueled by free energy dissipation to achieve their 
biological functions. Energy dissipation liberates the net¬ 
works from constraints such as the Fluctuation Dissipa¬ 
tion Theorem and Detailed Balance. Here, we show in 
a negative feedback network that the long-time output 
response A{y) = aad(e) decreases with the free energy 
dissipation y « Tad IF exponentially, and its fluctuation 
ay = decreases as y~^. Both these effects, espe¬ 

cially the slower decay of a^ with y, contribute to en¬ 
hance the short time response (?/)max, see Fig. 4. 

Even though FDT is broken in the adaptive sys¬ 
tem studied here, fluctuations and long-time response 
of the output are linked via a non-linear relation: cr^ « 
dye/ log{yc/A{y)) +al^, where d = ka/ and y^ = aad(e). 
Unlike the linear non-equilibrium FDT derived by a 
change of observables [24-26], our non-linear relation 
links observables that are conjugate at equilibrium, mak¬ 
ing it particularly appealing. Another approach is taken 
in [27], where near equilibrium linear response is used to 
show that the dispersion of variables can be reduced by 
dissipation. Adaptation however is a far from equilib¬ 
rium phenomenon which requires a critical finite amount 
of free energy dissipation. As a result, the energy scale 
is set by the intrinsic energy y^ instead of the thermal 
energy feeT in [27]. It remains a challenging question 
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whether these approaches can be combined to obtain a 
general relationship among response, fluctuation, and en¬ 
ergy dissipation for systems far from equilibrium. 
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SUPPLEMENTARY MATERIAL 
Continuum limit of feedback adaptation. 

The out-of-equilibrium dynamics of the discrete model 
in its phase space A x M G {[0,1], [0,iV]} are governed 
by six sets of rates. The rates uio{M) govern the transi¬ 
tions from the inactive A = 0 states to the active A = 1 
states, and the rates 0 Ji{M) the reciprocal inactivation 
transitions. The memory of active states is increased 
with a rate kf{M) and decreased with a rate ki{M). 
For inactive states, the memory can increase with a rate 
kQ (M) and decrease with kQ{M). 

Given the free energy from Eq. 1, we have that the 
rates of passive activity transitions satisfy detailed bal¬ 
ance, 

^l{M) ^ Fi(M)-Fo(M) ^ -[(M-M,)F-(S'-S',)] 

MM) 

The memory transitions are driven out of equilibrium, 
and in general we have 


To obtain the continuum theory we perform an expan¬ 
sion in the number of memory states iV, and then take 
the limit fV —>■ oo. This changes the discrete variable 
M € [0,iV] to the continuous m € [0,1]. The proba¬ 
bility density is defined by pAim) = P{A, M)/N, where 
m = M/N. Furthermore, for the continuum limit to ex¬ 
ist, the parameters p = NG, e = NE and m-r = M^/N 
have to be kept constant as TV —)• oo. Using this, the 
continuous free energy is simply given by 

/A(m) =-(A - l/2)[(m - TOr)e - (S'- Sr)] , 

which through detailed balance dehnes the continuous 
activation and inactivation rates uJo(jn) and uJi{m) up to 
a time scale. Dividing now the bulk master equations by 
N and expanding to second order in 1/iV results in two 
chemically coupled Fokker-Planck equations 

dtPi = Powo - PiUJi - HidmPi + DidMi 

dtPo = Piwi - poujo - HodmPo + DodMo , (10) 

where the drift and diffusion coefficients are given by 


^0 ^ gFo(M)-Fo(M+l)+G ^ ^-E/2-\-G 

K 

^1 _ ^Fi(M)-Fi(M+l)+G _ ^EI2-G 

k^~ 

where the ratios are independent of M, and G is the free 
energy input in the reactions which keeps them out of 
equilibrium. When there is no free energy input the sys¬ 
tem satishes detailed balance and its dynamic are simple 
equilibrium relaxation. For large values of G the memory 
only increases for inactive states and decreases for active 
ones, the chemotaxis limit [11]. 

The dynamics of this system are governed by the mas¬ 
ter equation. For the bulk states it is best written as two 
coupled equations 

dtPi{M) = Po{M)u;o{M) + Pi(M - 1)A:+ 

+ Pi[A4 + — Pi (A/) [u^i (A(f) + P ^i] 5 

dtPo{M) = Po{M)ujo{M) + Pi(M - l)kt 

+ Pi(Af + 1)^1 — Pi (A/) [u^i (A(f) + k^ “1“ ] 

For the upper boundary M = N we have 

dtPA{N) = Pi_A(lV)wi_^(iV) + Pa{N - l)k\ 
-PA{N)[u:A{N) + k-^] , 


Ha 


lim 
N —¥OC> 



Da 


lim 
N —yoo 


k\ + ^A 

2 iV 2 


To calculate the first limit, we can use that 

kA - ^A ^ +kA^- k~Alk\ 

N 2A2 l + k2/k+ ’ 

and expand in 1/A^ the ratio of rates, which results in 
Hq = —(e/2 — p)Do and Hi = (e/2 — Note that 

Ho = Do{-djnfo + p) and Hi = Di{-dmh - p), where 
the difference in sign in front of the chemical driving is 
due to the fact that memory transitions are driven in 
opposing directions for active and inactive states. 

Finally, proceeding in the same way on the discrete 
boundary equations gives at m = 1 and m = 0 the 
boundary condition 


0 = Hap A - DAdmPA , 


which is nothing but a no-flux condition. A verification of 
the convergence of the discrete to the continuous solution 
on the steady state appears in Fig. 5 A, where the discrete 
model was solved numerically for increasing values of N. 


Self-consistent choice of diffusion constants 


and analogously for the lower boundary M = 0, we have 
dtPAiO) = Pi_AiO)^l-AiN) + PAiMj 

- PA{0)[tOA{0) + k+] . 

A general solution of the master equation can be obtained 
using standard linear algebra [13]. 


The constants Dq and Di with units of frequency 
are analogous to the diffusion constant of a random 
walk. They define the characteristic time scale of the 
m-dynamics, as well as the value of the adapted activ¬ 
ity. In fact, the adapted activity for the discrete model 
is reached when G —> oo and ki = 0 = /c/", which results 
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FIG. 5: A) Convergence of the steady state solution of the 
ME P{M) to the FPE solution p{m). Parameters as elsewhere 
in the text, with = 20/ic and S = Sr- B) Numerical solu¬ 
tion of the FPE (black) and two analytical approximations, 
the Gaussian (red) and the adiabatic using the potential h. 
Parameters as in B. C) In black, the equilibrium contribution 
to dmh, and in shades of blue the non-equilibrium contribu¬ 
tion for different values of fi. Both in units of e and as a 
function of m, with the range [0,1] delimited by dashed lines. 
Sine these terms have opposing sign, see Eq. 16, extrema cor¬ 
respond to points where a blue line crosses the black line, and 
if the slope of the blue curve is higher than that of the black 
one they are minima. As one can see, the maximum (in red) 
disappears through the left boundary, while the minimum (in 
green) comes through the right one. This feature makes the 
transition second order. 


in Cad = /(^o" + ) [11]- Using the expressions for 

Dq and Di, this gives 


^ad — 


Do 

Do + Di 


( 11 ) 


The time scale of adaptation Tad defines the rate at which 
the memory relaxes, which in the discrete case is given by 
. In the continuum limit however the relaxation 
rate of the memory is given by (e — p)(Do -\- Di). Since 
accurate adaptation is reached in the regime /r —>■ oo, 
which should not affect the adaptation time, we choose 
the diffusion-like constants as 


Da 


Da 

Tad(e -b p) 


as can be verified by taking the limit N ^ oo which de¬ 
fines Da- For this choice, we have that in the irreversible 
limit the “diffusion” term of the master equation for fi¬ 
nite N is 


lim 
G—yoo 


k\ 


kA = 


2N 

'^ad 


ultimately determined by the adaptation time. The same 
is true for the “drift” of active and inactive memory 
states, which are given by 

+ _ 2iV . + _ 2iV 

lim fcff — fcn = - and lim kT — k^ = -. 

G—^oo Tad G—>-oo Tad 


These choices of time scales, which together with the 
ratio of the rates uniquely defines all rates, ensures that 
the adaptation time takes a value of order Tad in the 
discrete and continuum models alike. Indeed, as can be 
seen in Fig. 5 D, the response of the activity for a step 
change in ligand in the adaptive regimes is essentially the 
same for the continuous and discrete cases. 


Perturbative expansion for fast activity transitions 


Even at the steady state, Eqs. 10 are hard to solve 
analytically without any further assumption. In most 
sensory adaptive systems however there is a clear separa¬ 
tion between the adaptation time Tad and the activation 
time Ta ^ Tad, which we can use to obtain approximate 
solutions of pAim). Consider that uia = ^Aj'^ai where 
from now on bars will denote dimensionless quantities, 
and Q are of order unity. We can then define the param¬ 
eter b = TajT^o-, and write the dimensionless steady state 
equations 


PqOJq -piUJi -;— dmJi = 0 

e + p 

PiQi -poivo - ^—dmJo = 0 

e + pL 


( 12 ) 


where the dimensionless fluxes are defined using Da- In 
addition to these equations, because of total flux conser¬ 
vation, we have that dm(,Jo + <^i) = 0, which together 
with the boundary conditions gives 


i/q T t/i — 0 


(13) 


with the dimensionless constants Da of order one chosen 
such that Eq. 11 is satisfied. 

Note that this choice of diffusion constants limits the 
choice of rates in the discrete model, of which we have 
so far only specified the ratios. One choice of time scale 
compatible with the Da above is 

, , , _ 27V 1 -b e^D+G 


Since typically in adaptive sensory systems (5 ^ 1, it is 
natural to expand the steady state probabilities as 

PA = P^A + ^p‘'a + ^'^P^A + ■ • ■ ( 14 ) 

We now provide the equations for the first two terms of 
this expansion. 

Zeroth order- We begin by using the definition of 
conditional probability, which gives and 


























= (1 — Here is the conditional activity 

distribution to zeroth order, which we call a{m) in the 
main text; and the marginal memory distribution to 
zeroth order, noted in the main text as p(m). To zeroth 
order, Eq. 12 establishes that 

- ( 0 ) - ( 0 ) 

WoPo = WlPi 


The second derivative of h characterizes whether the 
point is a maximum or a minimum. 

At equilibrium we have p = 0, and the only extrema 
occurs at the value 

m» = rur + (S'— 5'o)/e . 


which is a no-flow condition for the activity transitions. 
From it, we can derive that = wo/(wi-l-wo)- Inserting 
this in Eq. 13 gives to lowest order 

-9™[(.Dia(°)+5o(l-a(°)))p(°)] =0 , 

This equation has a solution of the form = 

exp>(—h)/Z, where Z is a normalization constant and h 
is an effective non-equilibrium potential. This potential 
can be integrated analytically, which results in 


Note that, for m* to be an extrema it must fall in the 
range [0,1], something which we assume from now on. At 
m» we have that a(m*) = 1 / 2 , which corresponds to the 
maximal sensitivity of the activity to changes in the sig¬ 
nal. It is easy to show, however, that for p = 0 this point 
is unstable, since d'^h < 0. Because there is no other 
extrema, the memory will accumulate at the boundaries, 
which shows that adaptation to a high sensitivity state 
is not possible in equilibrium. 

When ^ 7 ^ 0, there can be two extrema of the potential 
h. At ^ = 0 we still have m*, however at —)■ oo we have 


. / / ’Tie 

h{m,S) = ( — -tlog 


I -b wo/wi 




1 


Do/Di + LOol^i 


(15) 


The validity of this solution can be verified by substitu¬ 
tion in Eq. 15. 

First order. The correction of first order in 6 is p^^'^ ■ 
Since we preserve the normalization of the zeroth order 
term, the first order term has as normalization condition 
SgiPo^^m) + p[^\m))dm = 0. From Eq. 12, the first 
order term directly gives 


- ( 1 ) 
^oPo 


- ( 1 ) 
■ i^iPi 


r) r 


(0) 


= 0 


which shows that to this order part of the m-flux is de¬ 
viated as probability currents on the activity transitions. 
The global flux balance in Eq. 13 becomes 




Unfortunately these two equations can not be solved an¬ 
alytically. In the following, analytical approximations 
are made using only the zeroth order contribution to the 
probability. 


Characterizing the adaptive transition 


To characterize the onset of adaptation, we study the 
extrema of the non-equilibrium potential. The condition 
for a point m to be an extrema is dmh = 0 , where we 
have 


®_!_ IL ^ _^_) 

2 I-bwi/wo e /2 y 2 1 -|-d?oWi/<^o-Di / 

(16) 


TOad(M OO) = nine = + {S - S^) / 6 + € ^ \og{Do/Di) 

(17) 

where rUne is the m value at the minimum of the nonequi¬ 
librium contribution to the effective free energy, i.e., the 
first term on the right hand side of Eq. (5) in the main 
text. At TOad the activity is a(mad) = Dq/{Dq + Di), 
which deviates from the maximum sensitivity point. 
Note that for Wad to be a minima it must fall in the range 
[0,1], which determines the range of signals to which the 
system can adapt. For the case in which m^d € [0,1], 
there is a transition at intermediate values of p from mgq 
being an unstable point, and the probability accumulat¬ 
ing to the boundaries; to Wad being a stable state, and 
the system being adaptive. By using a graphical con¬ 
struction of djnh, see Fig. 5 C, one can show that this 
transition is second order. We now describe the phase 
transition step by step. 

Near equilibrium and still far from the critical point the 
memory accumulates at the boundaries. Which bound¬ 
ary is more stable depends on the value of the signal. As 
p increases the maximum (which is m* at equilibrium) 
is displaced towards m = 0, for T>o/-Di > 1) or m = 1 
, for Dq/Di < 1. Eventually the maximum leaves the 
range [0,1], and there is just one stable boundary (the 
opposite to the one through which the maximum left) 
where the memory accumulates. Right at the critical 
point Pc = e/2 the energy landscape has no extrema in 
m G [—oo,-|-oo]. For values p > Pc a, minima develops 
asymptotically on the side opposite to the one through 
which the maxima left. Eventually this minima comes in 
the range [0,1] through the boundary where the mem¬ 
ory resides, and moves asymptotically to the value Wadj 
which is reached for /r —)■ oo. Because the memory is con¬ 
tinuously taken from the boundary to the adapted point, 
this phase transition is second order. 
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Fully irreversible limit 


A useful limit to study the continuous equations is 
/z —>■ oo to all orders in 6. Note that in this limit Eq. 13 
becomes simply 

-Dipi{m) + DoPo{m) = 0 . 


This equation is satisfied by the following expressions 


Pi{m) 

Po{m) 


i^o{rn) 

uJo{m) + a;i(TO) 
u!i(m) 
uJo{m) + 


6{m 

5{m 


Wad) 
Wad) , 


which also satisfy the normalization condition. This ex¬ 
pressions indicate that in the fully irreversible limit the 
memory is exactly fixed to its adapted value, as the dif¬ 
fusive terms vanish. The average activity is thus clearly 
Oad- In this limit the activity transitions are simply gov¬ 
erned by the two states master equation 


dtpi = wopo - wipi . (18) 


Derivation of Eq. 7 


To obtain an analytical expression of the adaptation 
error we use Eq. 13. Using this equation and defining 
the average activity as {A) = pi{m)dm we get: 

Hi{A) + Hoil - (A)) = .Dipi(l) + ^oPo(l) 

- {Dipi{0) + Dopo{0)) , 


which is valid to all orders. Note that when /i —> oo 
the average activity converges to the adapted value Oad 
in Eq. 11, in agreement with the solution derived above 
on the fully irreversible limit. The adaptation error of 
the output is defined as 


y ^ad 
e =- 

^ad 

Since (y) = (A), we can use the previous equation to 
show that (e) = ei — cq, with 


-DiPi(l) + DoPojl) 
-Do (e/2 - p) 
DiPi(O) + DoPo(O) 

Do(e/2 - p) 


(19) 


Thus to obtain the error we just need to evaluate p at 
the boundaries. 

We calculate the zeroth order term, and for compact¬ 
ness note a^^^(m) as a(m), as done in the main text. 
Although to this order we have an exact form for the po¬ 
tential, we can not exactly integrate e~^ to obtain the 
normalization Z. Deep into the adaptive phase, we can 


drop the equilibrium component of h and use a saddle 
point approximation with expansion parameter p/pc 3> 1 
to evaluate Z: 


Z = 






where the subindex indicates that h and its derivative are 
to be evaluated at Wad- Inserting this in the expression 
for the errors we have 

^ Abo(b) + Ai_6(l-o(6)) ^ (20) 

Do(/ic-Ai) V 27r 

where & = 0 or 6 = 1 for each of the two boundary 
contributions to the error. While these expressions are 
analytical, their evaluation is not transparent due to the 
complicated form of the potential. A simpler expression 
can be obtained by evaluating h(l) and h(0) by an ex¬ 
pansion around rUad- Truncating to second order we have 

^ _ Abo(6)-fAi_b(l-a(6)) [pp^ 

^ Ao{pc - p) \l 2Tr 

We now define the characteristic error 

^ _ A{,q(&) -I- Ai_fc(l - a{b)) I ppc 
Ao{pc-p) V 27r 

which has a weak dependence on p. Introducing the con¬ 
stant k = {b — mad)^/2, we arrive at the following esti¬ 
mate for the adaptation error 

(e) « , (21) 


where for simplicity we consider the case of large sig¬ 
nals, in which rUad is also high and the error contribu¬ 
tion comes dominantly from the boundary 6=1. This 
expression is accurate up to order 6, and corresponds to 
Eq. 7 in the main text. It is important to note that the 
higher order terms do not imply saturation, since it was 
shown at the beginning of this section that when /x —)■ oo, 
then {A) —)• Oad to all orders. 


Noise spectrum of output 

The output generated by the system activity is given 

by 

1 / 
y{t) = 0(t- ^/^«A(t')dt' , 

'^y J—CO 

where 0 is the Heaviside step function. This corre¬ 
sponds to a relaxation of y towards A in a time scale 
Ty. Using the dehnition of Fourier transform /(w) = 
( 27 r)“^D J/(t) exp(—zwtjdt, the equation above trans¬ 
lates to 

y{u;) = ^^Aiu;) , (22) 

Ty + lOJ 
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where we have used that the time-domain convolution 
if * 9)it) is given by v^/(w)g(w). 

To calculate the power spectrum of the output, we first 
note that 


{A{u))A{uj')) = ^fffnSiu) + Lo')SAi'^) , 


where Sa is the power spectrum of the activity, which 
can be calculated by standard methods [13, 15]. From 
this and Eq. 22 we obtain 


Syiu) 


SAiuj)Ty ^ 
Ty"^ + Up- 


which we use to calculate the power-spectrum throughout 
this work. 

The power spectrum is related to the autocorrelation 
function through a Fourier transform, that is 

5 ^ 


e-*“*C'y(t)da; 


where the correlation function is defined as Cyit) = 
{y{t)y{0)). The second moment relates to the correla¬ 
tion function as 


(a;)dw 


Together with (y) = {A ), this equation allows to calculate 
the variance of the output. 

For the particular case of /i —)■ oo, the memory state 
is fixed to mad- The activity however still fluctuates 
between one active and one inactive state according to 
Eq. 18. In this case, the power spectrum of the output 
takes a particularly simple form. To calculate it, we use 
that the correlation of the activity is generically given by 


{A{t)A{0)) = X] 

A i,j 


where Ai = {1,0} is the activity observable, the sta¬ 
tionary probability distribution, A the eigenvalues of the 
bF—matrix, and q;!^ and z\ the corresponding right and 
left eigenvectors normalized by the condition z^-Qa' = 
S\\>. Eor the particular case of the activity we thus have 
[13, 15] 


{A{t)A{0)) ='^qxAZ\,iple^* 

A 


Erom Eq. 18 we have that the eigenvalues are 0 
and — (wq -|- wi), the corresponding right eigenvectors 
{a;o,wi}/(wi -b Wo) and {—1,1}, and the left eigenvec¬ 
tors {1,1} and {—wi, Wo}/(wi -bwo). The component 1 
of the steady state probability is simply the average ac¬ 
tivity, pI = (A) = u!o/iuJo+uJi). The correlation function 
is thus given by 

{A{t)A{0)) = (A) ((Al) + (1 - , 


from which one can verify that (^^(0)) = (A) and 
(A(oo)A(O)) = {A)"^. The power spectrum of the activity 
is then 

5'^(a;) = a/^(aI)^(5(w) 

+ {A){1-{A))^ , . 

V TT (Wo + UJi)^ + 

Using this expression, the relationship between the power 
spectrum of y and A, and defining the activation time as 
Ta = l/(wo -b wi), we obtain the second moment of the 
output to be 

(y^) = ( {AfV^ + - X2 ~ (^)(1 - 

V 27r \ '^y '^a Ty \ TT J 

= {Ar + ^^{A){l-{A)) 

Erom this, we obtain that the variance of the output in 
the fully irreversible regime is given by 

al^ = {A)il-{A))-^ , (23) 

'a “r Ty 

which contains the intrinsic activity fluctuations, aver¬ 
aged by the CheY-P dynamics [12]. This defines the 
saturation error noise, which can be averaged out by re¬ 
ducing the ratio TafTy. 


Derivation of Eq. 9 

As described in the main text, there are two contribu¬ 
tions to the fluctuations of the output. The first comes 
from the fluctuation of y around aim), we note it 
and was calculated before in the case /r —)■ 00. The second 
comes from the fluctuations of m itself, which make a(m) 
fluctuate, and we note it cr^. When there is a separation 
of time scales Ta Ty Tad, we have that the total out¬ 
put variance is the sum of these two contributions. Thus, 
using 0-2 = Oadcr^, we have that cr^ = {(7l+a'^^)/aad- For 
finite values of p the memory fluctuations dominate and 
CTa is the most relevant contribution, however as /i —)■ 00 
the memory gets frozen and dominates. It is thus 
crucial to calculate the dependence of a'^ in p. The main 
steps on how to calculate are given in the main text. 


DISSIPATED WORK 


To quantify how far from equilibrium the system is, 
we use the dissipated work W. At the steady state, and 
having set the thermal unit to one, we have 



r P 

"'o 

.DqPo 


Dipi 


+ ipoLOo -piUJi)\0g 


f Popo\ 

KPP^iJ 


dm . 
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We can estimate this quantity in the highly irreversible PARAMETERS 

limit /i ;g> /ic to zeroth order in S. In that regime, we 

have 


Dopo Dipi \ 

1 

= I [DqPo + Dipi] dm 
JO 

= — (Zio(l — flad) + -DlOad) ■ 

For the case considered in the main text in which Dq = 
Di, we have that W « Ilil-Do/^ad- 



Unless otherwise specified, the parameters used in the 
continuum limit are: e = 8, mr = 1/2, d = 1/e, S'r = 0, 
S = 2.5, Dq = Di, Ta = 10“^S, Ty = 10“^S, Tad = lOs. 
The parameters for the discrete model are used taking 
these as references and using the appropriate N rescal¬ 
ing. For iV = 5 as in U. Colt chemotaxis the resulting 
parameters are those in [17]. 



